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ABSTRACT 

Three-dimensional  (3D)  pointdoud  modelsoftreesweredeveloped  using  the  software  packages 
Maya  and  MATLAB.  These  models  are  to  be  assembled  into  a  forest  scene  that  can  be  used  for 
produci  ng  si  mulated  Laser  Detection  and  Rangi  ng  (LA  DA  R)  i  imagery  of  objects  obscured  beneath 
the  canopy.  This  document  describes  the  approach  for  modelling  the  trees  using  Maya  then 
importing  and  completely  reconstructing  the  models  in  a  custom  3D  point  cloud  format  in 
MATLAB. 
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3D  Point  Cloud  Tree  Model  ling 


Executi  ve  Su  mmary 

This  document  provides  an  overview  of  thedevelopment  of  three-dimensional  (3D)  point 
cloud  models  of  trees  using  the  software  packages  Maya  and  MATLAB.  This  work  was 
u  nd  ertaken  as  p  art  of  Task  07/ 105  Support  to  In  tel  I  i  gen  ce,  Survelll  an  ceandR  econ  n  ai  ssan  ce  to 
investigate  the  tasking  of  ai  rborne  sensors  to  detect  inconspicuous  targets,  particularly 
those  partially  obscured  by  forest  canopies.  An  important  aspect  of  this  task  was  to 
develop  a  representation  of  a  forest  scenethat  would  enablethe  model  ling  and  simulation 
of  an  airborne  foliage-penetrating  Laser  Detection  and  Ranging  (LADAR)  system. 

Theaimofthisworkwastoproduce3DmodelsofAu  stral  i  an  forest  trees  th  at  can  th  en  be 
easily  assembled  into  forest  scenes.  The  forest  models  and  models  of  target  vehicles 
generated  using  the  same  procedure  will  be  used  to  simulate  LADAR  imagery  in  later 
studies  to  assist  in  making  recommendations  for  the  military  operational  use  of  an 
airborne  foliage-penetrating  LADAR  imaging  system. 

The  trees  were  based  on  photographs  from  a  study  site  in  central  Queensland,  together 
with  survey  data  from  woodlands  near  the  RA  A  FTindal  base  in  the  Northern  Territory. 
N  o  further  validation  of  individual  tree  models  was  conducted. 
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1.  Introduction 

Tree  models  were  developed  and  assembled  into  a  representation  of  areal  world  forest  scene 
that  could  subsequently  be  used  for  simulating  the  imagery  that  is  produced  by  a  foliage- 
penetrating  Laser  Detection  and  Ranging  (LADAR)  system. 

Thecomputer  graphi  cs  and  model  I  i  ng  software  package  M  aya  can  be  used  for  generati  ng  tree 
models,  assembling  them  into  a  forest  scene,  and  also  has  the  capability  to  illuminate  the 
sections  in  the  scene  that  would  represent  the  imagery  captured  by  a  single  snapshot  of  a 
LADAR  system.  Maya  cannot  be  used  to  isolate  and  display  onlytheilluminated  sections,  nor 
merge  multi  pie  results  captured  from  different  viewing  angles.  Therefore  it  was  decided  to 
export  the  Maya  tree  models  to  MATLAB  and  then  develop  a  custom  software  tool  for 
si  mul  ati  ng  fol  i  age-penetrati  ng  LA  D  A  R  i  imagery  of  objects  obscured  beneath  a  forest  canopy. 

Thi  s  document  outl  i  nes  an  approach  for  model  I  i  ng  thetrees  usi  ng  M  aya,  then  i  mporti  ng  and 
completely  reconstructing  the  models  in  a  three-dimensional  (3D)  point  cloud  format  in 
MATLAB.  This  type  of  model  provides  a  way  for  representing  real  world  3D  objects,  such  as 
trees,  w  i  th  a  h i  gh  I  evel  of  d etai  1 .  1 1  i  s  si  mp I  y  a  set  of  voxel  s  (vol  u  me  el  ements  i  n  3D  space)  that 
describes  the  visible  surface  of  objects.  By  producing  a  3D  point  cloud  representation  of  a 
forest  scene  in  MATLAB,  where  each  point  is  the  centre  of  a  voxel,  a  simple  ray  tracing 
algorithm  could  bedevel oped  for  determining  thevoxels that  arewithi  n  direct  I ine-of-sightto 
a  LA  DA  R  sensor. 


2.  Tree  M  odelling  in  M  aya 

2.1  Developmentof  the  tree  models 

M  aya  was  used  to  generate  the  original  tree  models  that  were  representative  of  the  Australian 
environment.  Thedimensions  of  the  tree  mod  els  were  based  on  asurvey  of  woodlands  in  the 
vi  ci  n i ty  of  RA  A  F  Ti  nd al ,  N  orthern  Terri tory  [  1] ,  w h i  I  e  the  overal  I  ap pearance  w as  based  on 
photos  of  poplar  box  ( Eucalyptus  populnea)  from  woodlands  in  the  Injune  Landscape  Study 
Site  in  central  Queensland  [2], 

The  tree  models  (Figure  1)  were  developed  with  a  subset  of  Maya's  3D  paint  effects  called 
'tu  bes' .  Tu  bes  are  abl  e  to  emu  I  ate  the  creati  on ,  growth  and  behavi  ou  r  of  pi  ant  I  i  fe,  control  I  ed 
by  a  comprehensive  set  of  parameters  that  define  the  shape  and  growth  behaviour  of 
bran  ch  es,  tw  i  gs  an  d  I  eaves.  The  trees  w  ere  i  n  i  ti  al  I  y  based  on  an  examp  I  e  mod  el  of  a  med  i  u  m- 
sized  birch  tree,  which  was  modified  to  createa  set  of  models  resembling  poplar  box  trees. 

These  tree  models  could  be  directly  assembled  i  nto  a  forest  scene  i  n  Maya.  With  the  use  of 
I  i  ghti  ng  effects,  the  secti  ons  of  theforest  scene  represent  ng  the  i  imagery  captu  red  by  a  si  ngl  e 
snapshot  of  a  LADAR  system  could  be  illuminated.  While  this  was  the  logical  solution  to 
implement  for  modelling  a  foliage-penetrating  LADAR  sensor,  it  was  not  possible  to  use 
M  aya  to  d  i  spl  ay  onl  y  the  i  1 1  umi  nated  secti  ons  (w  hi  ch  represent  the  si  mul  ated  L  A  D  A  R  i  mage), 
combi  nemulti  pie  results  from  different  viewing  angles,  or  to  conduct  further  analysis  on  the 
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results.  It  was  therefore  decided  to  produce  a  3D  point  cloud  model  of  the  Maya  trees  in 
MATLAB  and  develop  a  customised  model  specifically  for  simulating  a  LADA R  sensor  to 
overcome  these  issues.  This  approach  should  also  enable  real  world  forest  data  stored  in  a 
point  cloud  format  to  be  used  in  the  model  ling  and  simulation. 


Figurel:  Rendered  imageofa  tree  model  produced  in  M  aya 

2.2  Extracting  and  exporting  the  models 

To  export  the  Maya  models  to  M  ATLA  B  for  further  man  i  pul  ati  on,  a  procedurewas  developed 
which  madeuseof  Z-buffer  images.  TheZ-buffer  is  the  component  of  Maya's  native  output 
format  (Interchange  File  Format)  which  indicates  furthest  visibledepth. 

TheZ-buffer  was  extracted  and  manipulated  to  export  to  MATLAB  via  a  plug-in  module 
dev  el  oped  usi  ng  C  ++ 1  i  brari  es  that  are  part  of  the  M  aya  package  (see  A  ppend  i  x  A  for  some 
details).  This  depth  information  was  saved  in  a  text  file  that  could  be  easily  exported  to 
M  ATLA  B.  These  text  fi  I  es  contai  n  posi  ti  vefl  oati  ng  poi  nt  val  ues  represent  ng  di  stances  from  a 
user-defined  reference  plane  (located  infront  of  the  camera)  to  pixelsinthe  rendered  scene. 
The  information  in  this  text  file  can  be  plotted  to  produce  a  depth  image  of  the  object 
(Figure2).  The  pixel  resolution  of  thedepth  image  is  limited  by  the  graphics  and  processing 
capabi  I  i  ti  es  of  the  comp  uter .  These  i  mages  w  ere  captu  red  at  a  resol  uti  on  of  1280  x  1024  p  i  xel  s 
with  an  orthographic  projection  so  that  perspective  distortion  was  not  introduced. 
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Depth  value 


0  256  512  768  1024  1280 

F  i  gure  2:  D  epth  i  mage  of  the  tree  in  Figurel.T  he  grey  seal  e  i  n  di  cates  the  depth  val  u  e  associated  with 
each  pixel,  where  black  is  closest  to  the  camera  and  white  is  furthest  away. 

Since  the  depth  image  from  a  single  viewpoint  of  the  tree  does  not  provide  sufficient 
information  to  reconstruct  a  complete  3D  point  cloud  model,  it  was  necessary  to  capture  and 
combi  ne  depth  i  mages  from  multi  pi  e  vi  ews  around  the  tree.  For  each  tree  model ,  a  seri  es  of 
four  depth  images  were  captured  at  90°  intervals  around  thetree  (Figure  3).  For  completeness 
a  fifth  depth  image  was  also  captured  from  above  the  tree  to  provide  a  top-down  view. 


Figure 3:  T op  view  layout  of  the  camera  positions  for  capturing  depth  images  of  a  tree  model.  The 
pivot  point  was  located  at  the  base  of  the  trunk. 

A  consequence  of  creating  3D  point  cloud  models  is  that  quantisation  errors  areintroduced 
such  that  the  model  in  MATLAB  is  a  slightly  coarser  representation  of  the  original  Maya 
model.  This  error  could  be  reduced  if  a  higher  resolution  depth  image  was  used,  but 
producing  such  an  image  would  require  a  computer  with  greater  graphics  and  processing 
capabilities. 
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Thedistancefromthecamera  to  thepivot  point,  located  atthebaseofthetrunk,  wasthesame 
for  all  viewsof  each  tree  and  set  to  the  shortest  distance  such  that  thelargest  tree  model  was 
contained  in  the  field  of  view  of  the  camera.  This  provided  the  highest-possible  resolution 
i  magewhi  I  emai  ntai  ni  ng  a  constant  di  stance  between  thecamera  and  pivot  poi  ntfor  al  I  trees. 


3.  Reconstructing  the  Tree  Models  in  MATLAB 

3.1  Reading  and  formatting  the  model  images 

The  text  files  containing  the  depth  information  about  the  image  were  read  into  a  two- 
dimensional  (2D)  array  in  MATLAB.  The  row  and  column  coordinates  of  each  elementinthis 
matrix  correspond  to  the  positi  on  of  the  pixel  i  n  the  depth  i  mage  and  its  val  ue  represents  the 
distance  from  a  user-defined  reference  plane  located  in  front  of  the  camera  (depth  value). 
Based  on  images  of  simple  geometric  test  objects,  these  depth  values  appear  to  be  evenly 
spaced.  By  default,  a  depth  valueof  10  OCX)  represents  empty  space.  Thisvalueissignificantly 
I  arger  than  any  val  ue  representi  ng  a  pixel  that  exi  sts  on  thetree  model .  Therefore  a  search  of 
this  matrix  was  performed  to  find  the  row  and  column  coordinates  of  all  depth  values  less 
than  10  000.  This  search  retu  rns  a  I  i  st  of  row ,  col  u  mn  and  d  epth  val  u  e  coord  i  nates  for  the  tree 
model,  hereafter  referred  to  as  (r,c,d)  coordinates.  Each  tree  model  was  formed  using  the 
four  sets  of  ( r,c,d )  coordinates  that  are  generated  from  the  four  depth  images  captured 
around  each  tree.  The  top  view  was  not  used  in  this  stage. 

3.2  T ransforming  the  depth  information  in  the  images 

The  3D  pointcloud  model  consists  of  integer  (x,y,z)  coordinates  defining  thecentreof  each 
voxel.  But  si  nee  the  depth  imagesdo  not  contai  n  any  information  about  thesizeof  thepixels 
in  terms  of  depth  values,  the  sets  of  (r,c,d)  coordinates  for  each  tree  model  cannot  be  directly 
mapped  to  (x,y,z)  coordinates.  It  is  therefore  necessary  to  transform  the  depth  values  by 
applying  a  conversion  factor  (which  is  determined  from  the  depth  image  resolution)  and  then 
round  to  integer  values  to  generate  the  (x,y,z)  coordinateswhich  represent  thevoxels  in  3D 
space. 

Each  depth  i  mage  was  captured  at  a  resol  ution  of  1280  x  1024.  Combi  ni  ng  four  depth  i  mages 
taken  at  90°  intervals  at  a  fixed  distance  from  a  pivot  point  meant  that  the  tree  would  be 
contained  insideaspacewith  dimensi  ons  of  1280  xl024  x  1280  voxel  s.Atthis  resol  ution,  the 
distancein  3D  space  from  the  camera  to  the  pivot  point  is  1280/  2  =  640  voxels.  To  determine 
the  conversi  on  factor  to  appl  y  to  the  depth  val  ues,  I  et  P  be  the  d  i  stancef  rom  the  camera  to  the 
pivot  point  in  the  depth  image,  then  the  depth  conversion  factor  is  simply:D  =640/  P  . 
H  owever  P  is  not  known  in  terms  of  depth  value  units  and  the  depth  conversion  factor  D 
instead  needed  to  be  determined  from  the  depth  images. 

The  depth  conversion  factor  could  be  determined  from  any  two  of  the  depth  images  taken  of 
thetree  models  wherethepositi  on  of  thecamera  was  separated  by  exactly  90°,  e.g.  the0°  and 
90°  views  of  thetree  model.  For  a  given  row  r  =  a  in  these  two  views,  the  pixel  with  the 
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minimum  depth  value  in  the  0°  view,  d0r=a ,  should  align  with  the  pixel  with  the  mini  mum 
col  u  mn  coord  i  nate  i  n  the  90°  vi  ew ,  Cgo  r=a  (F  i  gu  re  4) .  Therefore  the  d  epth  conversi  on  factor  D 
for  row  a  is  determined  as: 


D(«)  =  min(Cgor=a)/  min(d0/=a) 


(1) 


D(a)  was  computed  for  multiple  rows  and  an  average  taken.  Once  this  average  D  was 

determined  forthetreemodel,thedepth  valuesweremultiplied  by  D~  and  rounded  to  integer 
values,  hereafter  referred  to  as  d'  coordinates. 


Correct  alignment  of  every  voxel  in  the  two  views  is  not  possible  dueto  an  issue  with  the 
depth  information  extracted  from  Z-buffer  channel  in  the  M aya  I FF  images.  This  problem  is 
illustrated  in  Figure  4a  where  there  appeared  to  be  erroneous  or  misaligned  depth  values 
present  in  the  depth  images.  This  issue  was  ignored  at  this  point  and  dealt  with  after  an  initial 
3D  point  cloud  model  of  the  tree  was  produced  (§4.2)  si  nee  it  did  not  affect  the  process  for 
determining  the  depth  conversion  nor  the  mapping,  rotation  and  translation  of  the  image 
reconstruction  process  presented  in  §3.3. 


Figured  ( a )  Plot  of  the  (r,d)  coordinates  of  the  tree  model  for  the  0°  view,  (b)  Plot  of  the  (r,c) 
coordinates  of  the  tree  model  forthe90°  view.  T  heu  nits  of  d  (depth  values)  aredifferenttor 
and  c  (pixel  positions  of  the  depth  image).  Ignoring  erroneous  values,  if  d0  is  scaled 
correctly  then  all  voxels  in  the  I  eft  plot  should  align  with  a  corresponding  voxel  in  theright 
plot. 


3.3  Mapping,  rotation  and  translation 

The  sets  of  (r,c,d')  coordi  nates  from  thedepth  images  for  thefour  views  taken  from  around 
thetree  model  were  each  mapped  to  (x,y,z)  coordi  nates  and  then  rotated  and  translated  to 
form  an  overall  3D  point  cloud  that  describes  the  tree  model. 
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Mapping  each  set  of  ( r,c,d ')  coordinates  onto  the  3D  space  in  MATLAB  was  quite 
straightforward.  For  a  3D  image,  when  viewed  from  thef  rant  with  a  90°  vertical  rotation,  the 
hori  zontal  axi  s  i  s  x,  the  axi  s  i  nto  the  screen  i  s  y  and  the  verti  cal  axi  s  i  s  z.  Therefore  mappi  ng 
from  ( r,c,d' )  coordinates  to  (x,y,z)  coordinates  for  each  view,  ignoring  rotation  and 
translation  operations  which  were  performed  subsequently,  is: 

d'^x 

c->y  (2) 

Rh-r^z 

where  Rh  is  the  horizontal  resolution  of  the  depth  image  (Rh  =  1024  for  an  image  with  a 
resolution  of  1280  x  1024). 

Following  mapping  ontothe3D  space,  each  set  of  (x,y,z)  coordinates  were  rotated  aboutthe 
z  axis  so  that  thefour  images  taken  from  around  thetree  model  could  be  merged  together.  The 
(x,y,z)  coordinates  were  rotated  anticlockwise  about  thez  axisthrough  camera  position  6 : 


x' 

cos# 

-sin# 

0~ 

X 

y' 

= 

sin# 

cos# 

0 

y 

(3) 

z' 

0 

0 

1 

z 

The  process  of  mergi  ng  thefour  views  of  thetree  model  together  (Figure5)  was  completed  by 
shifting  thex  and  y  coordinates: 


-min(x^),^=  {O^gO^lSOP^O0} 

(4) 

-min(y,),0  =  {0°,90°,180p,270°} 

(5) 

y"i8o  =  y'i8o+max(y,90) 

(6) 

X"270  =  X'270+maX(x'0  ) 

(7) 

For  each  of  the  four  views,  the  data  along  all  three  axes  was  shifted  so  that  the  minimum 
value  in  each  direction  is  zero  (Eqns4and  5).  The  data  from  the  0°  and  90°  views  should  now 
align  correctly  si  nee  the  closest  voxel  to  the  camera  in  the  0°  view,  min(x0) ,  will  merge  with 
the  minimum  y  valuein  the  90°  view,  min(yg0) .  Additional  translations  were  required  for 
correct  alignment  of  the  180°  and  270°  views.  For  the  180°  view,  Equation  (6)  was  applied  so 
that  the  closest  voxel  to  the  camera,  mi  n(y180),  aligns  with  the  maxi  mum  y  valuein  the  90° 
view,  max(ygo).  For  the  270°  view,  Equation  (7)  was  applied  so  that  the  closest  voxel  to  the 
camera,  mi  n(x270),  aligns  with  the  maxi  mum  x  valuein  the  0°  view,  max(x0). 
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180°  view 


0°  view 

Figure  5:  T ranslating  thex  and  y  coordinates  to  align  and  merge  the  four  views  of  the  tree  model 


The  mapped,  rotated  and  translated  (x,y,z)  coordinates  for  each  of  the  four  images  were 
stored  in  a  single  list  which  describes  the  3D  point  cloud  representation  of  the  tree  model 
(Figure6).lfthereconstructionofthetreemodelwasaccuratethenthislistofvoxelswould 
contai  n  many  d  u  p  I  i  cates,  si  n  ce  th  ere  i  s  si  g  n  i  f  i  cant  over  I  ap  w  h  en  th  e  f  ou  r  v  i  ew  s  of  th  e  tree  are 
merged  togeth er .  A  t  th  i  s  p oi  nt  th  i  s  I  i  st  i  s  f  i  I  tered  to  remove  any  d  u  p I  i  cate  voxel  s,  i . e.  mu  I  ti  p I  e 
i  nstance  of  a  voxel  with  the  same  (x,y,z)  coordinates. 


-200  iooo 


Figure  6:  3D  point  cloud  model  of  the  M  ay  a  tree  shown  in  Figurel  reconstructed  in  MAT  LAB 
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4.  Improving  the  3D  point  cloud  model 

4.1  Problems  with  the  M  aya  model  data 

The  initial  reconstructed  3D  point  cloud  model  of  the  tree  (Figure  6)  had  a  significant 
proportion  of  voxels  that  were  incorrectly  aligned.  This  appeared  to  predominantly  occur 
around  the  trunk  and  branches  and  created  a  spray- 1  ike  effect  in  the  3D  plot.  While  it  was 
initially  thought  that  this  issue  was  caused  by  the  process  to  transform  thedepth  information 
(§3.2),  further  analysis  revealed  that  this  issue  had  been  caused  when  images  wererendered  in 
M  aya.  This  probl  em  w  as  not  encou  ntered  w  i  th  si  mpl  e  geometri  c  test  objects  such  as  cu  bes  or 
spheres,  or  with  models  of  vehicles. 

Figure  7  shows  the  unmodified  depth  image  for  the  0°  view  of  the  tree  model  where  the 
background  has  been  plotted  in  black.  Thewhitepixelsthatform  an  outlinearoundthetrunk 
and  branches  are  depth  values  that  are  significantly  further  away  from  the  camera  and 
responsible  for  creating  the  spray-1  ike  effect  observed  in  Figure  4a  and  Figure  6. 


Figure  7:  A  depth  image  of  the  tree  shown  in  Figure  1  with  zoomed  in  section  of  the  first  fork.  T he 
background  is  plotted  in  black  to  show  the  erroneous  data  (1-pixel  wide  white  outline) 
arou  ndthetrunkand  bran  ches.  The  grey  seal  e  i  n  di  cates  the  depth  vai  u  e  associ  ated  w  i  th  each 
pixel  of  the  tree,  where  black  is  closest  to  the  camera  and  white  is  furthest  away. 


At  present,  a  sol  ution  for  solving  this  issue  i  n  M  aya  has  not  been  found.  Theerroneous  depth 
values  seem  to  vary  from  anywhere  between  the  correct  depth  and  some  row-dependent 
maxi  mum.  Therefore  it  i  s  not  possi  bl  eto  easi  ly  removethem  by  appl  yi  ng  a  threshol  d  to  I  i  mi  t 
thedepth  values.  The  best-case  scenario  would  be  to  relocate  theerroneous  depth  values  by 
esti  mati  n  g  th  e  correct  values,  butthisisnotp  ossi  bl  e  i  n  the  crow  n  of  the  tree  w  h  i  ch  i  s  exp  ected 
to  contain  large  discontinuities.  Instead  a  template  masking  technique  was  developed  in 
M  ATLA  B  to  remove  a  si  gnifi  cant  proporti  on  of  the  erroneous  voxel  s. 
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4.2  Removing  erroneous  voxels  from  the  model 

Thetechni  que  dev  el  oped  for  removi  ng  the  voxel  s  i  n  the  M  ATL  A  B  3D  poi  nt  cl  oud  model  used 
the  i  nformati  on  contai  ned  i  n  the  depth  i  mages  to  perform  tempi  ate  maski  ng  that  removes  the 
majority  of  the  erroneous  voxels. 

Template  masks  were  defined  by  extracti  ng  the  (r,c)  coordinates  from  the  depth  images  of 
theO0  and  90°  views  around  thetreeandthetop  view  of  thetree looking  directly  down.  These 
coordinates  were  mapped  to  sets  of  (y0,z0),  (xg0,z90)  and  (xtop,ytop)  coordinates: 


co  -^y0 
Rh-r0^z0 


(8) 


cgo  xg0 

R  h  90  “ ^  Z90 


(9) 


C top  — *  X  top 

^  h  —  r top  y  top 


(10) 


where  Rh  is  the  horizontal  resolution  of  the  depth  image. 

Any  voxels  in  the  set  of  ( xm,ym,zm )  coordinates  describing  the  3D  pointdoud  representation 
of  the  tree  model  that  are  outside  of  the  template  masks,  defined  by  the  sets  of  (y0,z0), 
(x  g0 ,  Zgo )  and  (xtop,ytop)  coordinate  pairs,  were  removed  (Figure  8). 


To  remove  any  additional  erroneous  voxels  from  within  the  crown  of  the  tree  that  were 
mi  ssed  by  thetempl  ate  maski  ng,  an  i  sol  ated  I  ocati  on  test  w  as  performed  .This  identifi  ed  and 
removed  any  voxels  from  the  model  that  were  isolated,  i.e.  a  voxel  that  has  no  immediate 
neighbours.  Isolated  voxels  should  not  exist  in  the  tree  mod  el  and  werethereforedeemed  to 
be  erroneous. 
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Figure8:  Theprocess  for  removing  erroneous  voxels  from  the3D  point  cloud  model  ofthetree.  The 
template  images  ( top)  were  matched  to  the  un  filtered  images  of  the  tree  (middle)  and  non- 
matching  voxels  removed  (bottom). 
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4.3  Interpolating  missing  voxels  in  the  trunk  and  branches 

An  unfortunateconsequence  of  the  techniques  used  to  reconstruct  3D  point  cloud  models  of 
treesin  MATLAB  was  that  several  sources  of  error  were  introduced  resulting  in  adegradati  on 
of  the  quality  of  the  model.  In  particular,  removing  erroneous  voxels  from  the  model  rather 
than  relocating  the  voxels  to  their  correct  position  could  potentially  cause  gaps  to  appear  in 
the  trunk  and  branches  of  the  tree  where  the  different  views  should  overlap. 

Li  near  i  nterpol  ati  on  was  used  to  fi  1 1  i  n  any  gaps  that  exi  sted  i  n  thetree trunk  or  branches  from 
the  base  of  the  tree  up  to  the  crown.  The  interpolation  was  performed  on  adjacent  voxels  in 
every  layer  (thex-y  planeateachz  coordinate)  of  thetree  model.  For  thetree  trunk,  voxel  son 
each  layer  were  ordered  in  a  clockwise  direction.  The  linear  interpolation  was  performed 
between  pairs  of  voxels  on  this  ordered  list  and  the  algorithm  generated  all  of  the  missing 
locations  in  the  trunk  on  that  layer. 

However  abovethefirst  branching,  voxels  that  form  each  branch  must  be  identified  and  the 
interpolation  performed  as  described  above  but  on  the  branches  separately.  This  process  was 
semi -automated  by  using  theciusterdata  fundi  on  in  theMATLABStatisticsTool  box,  which 
performs  hierarchical  clustering  and  worked  effedively  when  unique  branches  were  not  in 
close  proxi  mity. 

Figure  9  illustrates  this  process  performed  on  a  single  layer  of  the  tree.  In  this  example, 
clustering  was  used  to  identify  thetwouniquebranchesthatarepresent  on  this  layer  of  thetree. 


Figure  9:  L  inear  interpolation  of  missing  voxels  in  the  branches  on  a  single  layer  of  the  tree  model. 
Thebluecircles  aretheoriginal  voxels  and  the  red  dots  are  the  interpolated  voxels. 

Itiscurrently  not  possibleto  interpolate  the  tree  trunk  or  branches  within  the  crown  of  the 
tree  in  an  automated  way  due  to  the  difficultly  in  distinguishing  between  voxel  s  that  form 
branches  or  leaves.  A  manual  process  could  be  used  to  visually  check  and  add  any  missing 
voxel  s  to  the  branches  i  n  a  I  ayer  wi thi  n  the  crow  n  of  thetree.  Thi  s  i  s  a  very  tedi  ous  and  ti  me 
consuming  process  that  was  not  undertaken  because  the  improvement  in  the  model  was 
expeded  to  be  mi  ni  mal . 
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4.4  The  final  model 

The  final  3D  point  cloud  model  of  thetree  (Figure  10)  was  saved  to  a  filefor  future  use.  Itis 
also  important  to  note  that  whilethis  document  has  focused  on  the  development  of  3D  point 
cloud  representations  of  trees  in  MATLAB,  itisfeasiblethatthesetechniques  could  be  applied 
to  other  types  of  models. 


FigurelO:  Final  M  ATLAB  3D  point  cloud  model  of  the  M  ay  a  tree  shown  in  Figurel 
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5.  Forest  Modelling 

5.1  Assembly  into  a  forest  scene 

A  forest  scene  (Figure  11)  was  produced  using  a  variety  of  tree  models  that  were 
reconstructed  in  MATLAB  using  the  procedures  described  in  this  document.  Individual  3D 
point  cloud  tree  models  were  placed  intotheforest  scene  by  shifting  theirx  and  y  coordinates 
such  that  each  tree  is  located  in  a  desired  position.  Care  needed  to  betaken  to  ensure  that  the 
trees  didn't  overlap.  Before  each  shifted  tree  model  was  added  to  an  overall  list  of  voxels 
descri  bi  ng  the  3D  poi  nt  cl oud  forest  scene,  a  vi sual  check  was  used  to  confi  rm  it  was  I  ocated 
correctly.  This  was  done  by  generating  a  plot  showing  the  new  tree  in  one  col  our  and  all  other 
previously  added  trees  in  a  different  colour. 


Figure  11:  3D  point  cloud  model  of  a  forest  scene  generated  in  M  ATLAB 

5.2  A  ssessi  ng  the  forest  model 

The  3D  point  cloud  representation  of  the  forest  scene  (Figure  11)  had  characteristics  of  an 
'open  forest',  i.e.  10-30  m  high  trees  with  30-70 %  foliage  cover  [3].  It  consisted  of  49  trees 
within  a  circular  area  of  approximately  50m  in  diameter.  There  were  18  trees  between 
20-30  m  high,  23  trees  between  10-20  m  high,  and  8  trees  less  than  5  m  high. 

The  forest  model  was  verifi  ed  by  determi  ni  ng  the  I  i  ght  penetrati  on  through  the  canopy  as  a 
function  of  depression  angle.  If  the  tree  crowns  can  be  assumed  to  be  a  random  uniformly 
distributed  volume,  then  the  light  transmission  away  from  vertical  is  [4]: 
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Te- Tvert  cosO  =  Tverts\n(?r/  2-6)  (11) 

where  <9  is  the  angle  from  vertical,  and  (W  2-6)  i  s  the  angle  from  horizontal,  i.e.  the  sensor 
depression  angle. 

Foliage  penetration  was  estimated  by  ray  tracing  through  the  forest  for  depression  angles 
between  45°-90°  at  15°  azimuth  increments  for  each  of  three  locations  in  the  forest  scene. 
These  I  ocati  ons  w ere  i  n  posi  ti  ons  that  a  veh i  cl  e  cou I  d  have  concei  vabl  y  d  ri  ven  to  betw een  the 
tree  trunks.  The  software  developed  in  MATLABto  simulate  LADAR  imagery  [5]  was  used 
for  this  calculation,  by  determining  the  number  of  rays  to  reach  a  flat  target  on  the  ground. 

A  I  east-squares  fit  of  Eq.  11  to  the  results  gavelet  =31.3%  (Figure  12),  although  a  straight  line 
was  found  to  give  a  better  fit  than  the  sine  function.  Si  nee  the  canopy  was  of  course  not  a 
homogenous  medium,  there  was  considerable  variation  in  the  light  penetration  at  each 
depression  angle. 


Figurel2  M  easu  red  light  penetration  of  the  forest  canopy  model  (o  mean  ±1  standard  deviation)  and 
predicted  penetration  (solid  red  line) 
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6.  Summary 

A  process  was  developed  to  create  realistic  3D  point  cloud  models  of  Australian  trees  in 
MATLAB.  The  software  package  Maya  was  used  to  create  the  initial  tree  models  and  a 
specially-developed  plug-in  was  used  to  extract  the  depth  information  from  images  of  the 
trees.  This  depth  information  was  obtained  from  multiple  views  around  each  tree  and 
exported  to  M  ATL  A  B  for  reconstructi  ng  the  trees  i  n  a  3D  poi  nt  cl  oud  format.  Thi  s  i  nvol  ved 
thetransformation  and  mappi  ng  of  the  depth  i  nformation  to  form  a  set  of  voxel  s  for  each  view 
of  the  tree.  These  sets  of  voxels  were  then  rotated,  translated  and  combined  to  form  a 
complete  set  of  voxels  representing  the  3D  point  cl  oud  model  of  each  tree.  A  final  template 
masking  process  was  applied  to  each  tree  model  to  remove  artefacts  introduced  in  the 
renderi  ng  of  thetree  i  mages  i  n  M  aya.  N  o  sol  uti  on  was  fou  nd  to  correct  thi  s  i  ssue  i  n  M  aya  and 
itwas  not  encountered  with  simple  geometric  test  objects  such  as  cubes  or  spheres,  orwith  a 
model  of  a  target  vehicle  which  were  generated  using  the  same  procedures  described  inthis 
document. 

The  tree  models  reconstructed  in  MATLAB  were  easily  assembled  into  a  representation  of  a 
forest  scene,  which  was  assessed  by  light  penetrating  testing.  This  3D  point  cloud 
representation  of  a  forest  and  a  model  of  atargdivehideweresuccessfully  used  with  software 
developed  in  MATLAB  for  modelling  and  simulating  aspects  of  an  airborne  foliage- 
penetrating  LADAR  imaging  system. 

This  work  ultimately  enabled  realistic  3D  LADAR  imagery  to  be  produced,  which  was 
su  bsequentl  y  used  i  n  operati  ons  anal  ysi  s  stud  i  es.  The  resu  I  ts  of  these  stud  i  es  are  anti  ci  pated 
to  assistin  making  recommendations  for  the  military  operational  use  of  an  airborne  foliage- 
penetrating  LADAR  imaging  system. 
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Appendix  A:  Details  of  Plug-In  to  Export  Depth 
Information  from  M  aya 


To  extract  the  depth  map  from  an  IFF  image,  a  C++  Maya  plug-in  was  created  using  the 
if f reader  library.  Each  individual  pixel  depth  value  may  be  accessed  using  the getDepth 
function  (given  thex  and  y  coordinates)  or  the  entire  map  by  thegetDepthMap  function. 

Additional  libraries  were  used  in  relation  to  general  plug-in  operations: 


#include  <maya/MPxCommand . h> 
#include  <maya/MStatus . h> 
#include  <maya/MArgList . h> 
#include  <maya/MFnPlugin . h> 
#include  <maya/MOb j ect . h> 
#include  <maya/MGlobal . h> 
#include  <maya/MString . h> 
#include  <maya/MPoint . h> 


SeetheMaya  API  manual  for  more  information. 
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